Performance Of Machine Learning Techniques Research Articles

Machine learning techniques in breast cancer preventive diagnosis: a review

AbstractBreast cancer (BC) is known as the most prevalent form of cancer among women. Recent research has demonstrated the potential of Machine Learning (ML) techniques in predicting the five-year BC risk using personal health data. Support Vector Machine (SVM), Random Forest, K-NN (K-Nearest Neighbour), Naive Bayes, Neural Network, Decision Tree (DT), Logistic Regression (LR), Discriminant Analysis, and their variants are commonly employed in ML for BC analysis. This study investigates the factors influencing the performance of ML techniques in the domain of BC prevention, with a focus on dataset size and feature selection. The study's goal is to examine the effect of dataset cardinality, feature selection, and model selection on analytical performance in terms of Accuracy and Area Under the Curve (AUC). To this aim, 3917 papers were automatically selected from Scopus and PubMed, considering all publications from the previous 5 years, and, after inclusion and exclusion criteria, 54 articles were selected for the analysis. Our findings highlight how a good cardinality of the dataset and effective feature selection have a higher impact on the model's performance than the selected model, as corroborated by one of the studies, which gets extremely good results with all of the models employed.

Application of the performance of machine learning techniques as support in the prediction of school dropout

This article presents a study, intending to design a model with 90% reliability, which helps in the prediction of school dropouts in higher and secondary education institutions, implementing machine learning techniques. The collection of information was carried out with open data from the 2015 Intercensal Survey and the 2010 and 2020 Population and Housing censuses carried out by the National Institute of Statistics and Geography, which contain information about the inhabitants and homes. in the 32 federal entities of Mexico. The data were homologated and twenty variables were selected, based on the correlation. After cleaning the data, there was a sample of 1,080,782 records in total. Supervised learning was used to create the model, automating data processing with training and testing, applying the following techniques, Artificial Neural Networks, Support Vector Machines, Linear Ridge and Lasso Regression, Bayesian Optimization, Random Forest, the first two with a reliability greater than 99% and the last with 91%.

Machine learning based software effort estimation using development-centric features for crowdsourcing platform

Crowd-Sourced software development (CSSD) is getting a good deal of attention from the software and research community in recent times. One of the key challenges faced by CSSD platforms is the task selection mechanism which in practice, contains no intelligent scheme. Rather, rule-of-thumb or intuition strategies are employed, leading to biasness and subjectivity. Effort considerations on crowdsourced tasks can offer good foundation for task selection criteria but are not much investigated. Software development effort estimation (SDEE) is quite prevalent domain in software engineering but only investigated for in-house development. For open-sourced or crowdsourced platforms, it is rarely explored. Moreover, Machine learning (ML) techniques are overpowering SDEE with a claim to provide more accurate estimation results. This work aims to conjoin ML-based SDEE to analyze development effort measures on CSSD platform. The purpose is to discover development-oriented features for crowdsourced tasks and analyze performance of ML techniques to find best estimation model on CSSD dataset. TopCoder is selected as target CSSD platform for the study. TopCoder’s development tasks data with development-centric features are extracted, leading to statistical, regression and correlation analysis to justify features’ significance. For effort estimation, 10 ML families with 2 respective techniques are applied to get broader aspect of estimation. Five performance metrices (MSE, RMSE, MMRE, MdMRE, Pred (25) and Welch’s statistical test are incorporated to judge the worth of effort estimation model’s performance. Data analysis results show that selected features of TopCoder pertain reasonable model significance, regression, and correlation measures. Findings of ML effort estimation depicted that best results for TopCoder dataset can be acquired by linear, non-linear regression and SVM family models. To conclude, the study identified the most relevant development features for CSSD platform, confirmed by in-depth data analysis. This reflects careful selection of effort estimation features to offer good basis of accurate ML estimate.

Evaluation of machine learning techniques for heart disease prediction using multi-criteria decision making

Globally, heart disease is the primary cause of death. Early detection of this disease enables cardiologists to make more accurate judgments regarding the health of their patients. Due to machine learning’s ability to identify patterns in data, its use in the medical industry has increased. Many heart disease prediction models have been developed by various researchers utilizing machine learning techniques (MLTs). The performance of MLTs on heart disease prediction may vary for different accuracy measures. Thus, the choice of the appropriate machine-learning technique for heart disease prediction is a challenging task. This paper proposes a multi-criteria decision-making (MCDM)-based method to evaluate the MLTs for heart disease prediction considering various performance measures taken into account altogether. The proposed approach uses the concept of a combined compromise solution (CoCoSo)- an MCDM method. For validation of the proposed approach, an experimental study was conducted to evaluate the performance of fifteen machine learning techniques for predicting heart disease over three heart disease datasets considering six performance measures taken into account altogether. Results show that the logistic regression and support vector machine are recommended as the most suitable MLTs for heart disease prediction modeling with respect to six performance measures considered simultaneously.

Enhancing Predictive Quality in HVOF Coating Technology: A Comparative Analysis of Machine Learning Techniques

This paper presents a comparative analysis of the performance of machine learning techniques for enhancing predictive quality in thermal spray coating technology, with a focus on the high velocity oxygen fuel (HVOF) process. The study aims for accurately predicting coating properties, which are pivotal in determining coating quality in HVOF applications. By investigating five influential factors, including the fuel-to-oxygen ratio and coating velocity, this research was designed to improve the understanding and control of these properties. Through advanced statistical design of experiments, correlations between these factors and key coating properties are established. Six machine learning models are trained and evaluated to assess their predictive capabilities for coating properties. The obtained results provide valuable insights into the HVOF coating process and highlight the potential of predictive model-based techniques for accurately predicting such properties. Furthermore, this research offers guidance for selecting an effective machine learning technique in the context of thermal spray technology.

Retracted: Analyzing the Performance of Machine Learning Techniques in Disease Prediction

Retracted: Analyzing the Performance of Machine Learning Techniques in Disease Prediction

Evaluating the impact of sampling designs on the performance of machine learning techniques for land use land cover classification using Sentinel-2 data

ABSTRACT In today’s world, by integrating remote sensing technology and modern state-of-the-art machine learning techniques, obtaining Land Use Land Cover (LULC) maps has become easier in comparison to traditional manual methods. The performance of a Machine Learning classifier is influenced by various factors. The objective of this study is to evaluate the impact of sampling design in rough complex terrain located in the Northern Himalayan region in Uttarakhand state, India, where reference data is often limited due to the geographical characteristics of the study area. Three sampling design strategies have been incorporated in this study, namely, stratified random sampling with a proportional number of samples (SRS)proportional, stratified random sampling with an equal number of samples (SRS)equivalent and stratified systematic sampling with an equal number of samples with a minimum distance of 10 m between the consecutive samples (SSS)D = 10 m for the LULC classification. In this study, Sentinel-2 data of 10 m spatial resolution for the study area of Dehradun district, Uttarakhand, India, has been selected. The following conclusions can be drawn from the results of this study (i) (SRS)proportional achieved the highest Overall Accuracy (OA) among all the three sampling techniques. The OA and kappa score (ka) using (SRS)proportional are OA = 90.25 and ka = 0.874 by Random Forest, OA = 88.84 and ka = 0.856 by Support Vector Machine and k Nearest Neighbours (kNN) obtained OA = 87.72 and ka = 0.842, respectively. (ii) It was found that in the case of (SRS)proportional, the majority classes like the deciduous forest, evergreen forest and cropland achieved higher recall and precision values in comparison to those obtained from the other two sampling strategies, i.e. (SRS)equivalent and (SSS)D = 10 m. (iii) The results showed that while switching from (SRS)proportional to (SRS)equivalent or from (SRS)proportional to (SSS)D = 10 m, there was a slight reduction in the precision and recall values for the majority classes and a slight increase for a few of the minority classes.

Control of chaotic systems through reservoir computing

Chaos is an important dynamic feature, which generally occurs in deterministic and stochastic nonlinear systems and is an inherent characteristic that is ubiquitous. Many difficulties have been solved and new research perspectives have been provided in many fields. The control of chaos is another problem that has been studied. In recent years, a recurrent neural network has emerged, which is widely used to solve many problems in nonlinear dynamics and has fast and accurate computational speed. In this paper, we employ reservoir computing to control chaos in dynamic systems. The results show that the reservoir calculation algorithm with a control term can control the chaotic phenomenon in a dynamic system. Meanwhile, the method is applicable to dynamic systems with random noise. In addition, we investigate the problem of different values for neurons and leakage rates in the algorithm. The findings indicate that the performance of machine learning techniques can be improved by appropriately constructing neural networks.

Predicating depression on Twitter using hybrid model BiLSTM-XGBOOST

Nowadays, depression is a common mental illness. Failure to recognize depression early or guarantee that a depressed individual receives prompt counseling can lead to serious issues. Social media allow us to monitor people's thoughts, daily activities, and emotions, including persons with mental illnesses. This study suggested novel hybrid models that combine one of the deep learning techniques with one of the machine learning approaches. This paper used a dataset from the Kaggle website to predict depression. Two deep learning techniques were chosen to conduct the experiments: bidirectional long short-term memory (Bi-LSTM), and convolutional neural network (CNN). Three machine learning techniques were also selected, which are support vector machine (SVM), light gradient boosting machine (LGBM), and extreme gradient boosting (XGBOOST). Deep learning methods were applied to extract important features from input data and training, and then machine learning was utilized to predict the class. The performance of the hybrid models was compared against that of five single models. The results showed that Bi-LSTM-XGBOOST is better than single models and achieve the highest performance, with 94% for all evaluation metrics. The proposed model can improve the performance of machine learning techniques and increase the detection rate of depression.

Determination of Johnson-Champoux-Allard model parameters with machine learning techniques

Acoustic modelling of materials is a key aspect to perform reliable predictions of untested configurations and to implement optimal strategies, especially nowadays, due to the development of 3D printing techniques allowing to generate deterministic microstructures in porous materials. However, this modelling is not straightforward due to the number of parameters characterizing porous materials. Each one of these parameters can be estimated experimentally with its own setup and procedure, not always easy to execute. On the other hand, the use of inverse methods for the estimation of parameters relies on physical approximations and requires experimental procedures that are strongly sensitive to boundary conditions. Consequently, experimental determination of the parameters of porous materials may become financially expensive and very time consuming. The purpose of this work is to investigate the performances of machine learning techniques in determining the parameters of Johnson-Champoux-Allard model, in order to understand whether missing values can be predicted just relying on a set of already performed experimental characterizations when not all the experimental setups are available. In particular, Gaussian processes are used on a training set describing porous materials in terms of Johnson-Champoux-Allard parameters and the values of acoustic indices at fixed frequencies.

Mapping Soil Organic Matter Using Different Modeling Techniques in the Dryland Agroecosystem of Huang-Huai-Hai Plain, Eastern China

Accurately mapping the spatial distribution and variation of soil organic matter (SOM) is of great significance for guiding regional soil management. However, the applicability and prediction performance of machine learning techniques in dryland agroecosystems still needs to be further studied. In this study, we collected a total of 733 topsoil samples from the farmland in Xiao County, Anhui Province, which is a typical dryland agroecosystem in the Huang-Huai-Hai Plain. Then, the environmental covariates were selected, and the ordinary kriging (OK), multiple linear stepwise regression (MLR), regression kriging (RK), radial basis function neural network (RBFNN), and random forest (RF) models were conducted to map the SOM content, and the optimal model was ascertained. The results demonstrated that the alkali-hydrolyzable nitrogen (26.11%), available potassium (17.73%), mean annual precipitation (13.26%), and pH (11.80%) were the main controlling factors affecting the spatial distribution of SOM in the study area. Meanwhile, the introduction of environmental covariates can effectively improve the SOM prediction accuracy, and the RF model (R2 = 0.48, MAE = 2.38 g kg−1, MRE = 12.99%, RMSE = 3.14 g kg−1) has a better performance than the RFBNN, MLR, RK, and OK methods. Although there are local differences in the spatial distribution of SOM predicted by the five methods, the overall spatial distribution of SOM was characterized by the low concentration area (13.44–20.00 g kg−1) distributed in the central and northwest of study area, and the high concentration area (24.00–28.95 g kg−1) distributed in the southeast. Overall, our study demonstrated that machine learning-based models could accurately predict the SOM content in dryland agroecosystem, and the produced maps function as baseline maps for sustainable agricultural management.

Analysis of Electrical Signals by Machine Learning for Classification of Individualized Electronics on the Internet of Smart Grid Things (IoSGT) architecture

This paper presents a study on the performance of Machine Learning techniques for the task of determining each of the electronics systems connected within the same electrical network, in the Internet of Smart Grid Things (IoSGT) architecture. This is regarded as an ecosystem which has cutting-edge technologies that work together to enable advanced SG applications, and run in core/edge cloud datacenters connected to an underlying IoT network infrastructure. This identification was carried out by analyzing traditional energy measures (i.e., voltage, current and power) through ML-based techniques. The analysis of regular energy measurements is required as a means of ensuring compatibility with legacy /smart meters, without the need to exchange them for new ones or make updates. The data was obtained by using a smart meter built by our group, and was processed and validated in the IoSGT edge-cloud.

Mitigating anomalous electricity consumption in smart cities using an AI‐based stacked‐generalization technique

AbstractEnergy management and efficient asset utilization play an important role in the economic development of a country. The electricity produced at the power station faces two types of losses from the generation point to the end user. These losses are technical losses (TL) and non‐technical losses (NTL). TLs occurs due to the use of inefficient equipment. While NTLs occur due to the anomalous consumption of electricity by the customers, which happens in many ways; energy theft being one of them. Energy theft majorly happens to cut down on the electricity bills. These losses in the smart grid (SG) are the main issue in maintaining grid stability and cause revenue loss to the utility. The automatic metering infrastructure (AMI) system has reduced grid instability but it has opened up new ways for NTLs in the form of different cyber‐physical theft attacks (CPTA). Machine learning (ML) techniques can be used to detect and minimize CPTA. However, they have certain limitations and cannot capture the energy consumption patterns (ECPs) of all the users, which decreases the performance of ML techniques in detecting malicious users. In this paper, we propose a novel ML‐based stacked generalization method for the cyber‐physical theft issue in the smart grid. The original data obtained from the grid is preprocessed to improve model training and processing. This includes NaN‐imputation, normalization, outliers' capping, support vector machine‐synthetic minority oversampling technique (SVM‐SMOTE) balancing, and principal component analysis (PCA) based data reduction techniques. The pre‐processed dataset is provided to the ML models light gradient boosting (LGB), extra trees (ET), extreme gradient boosting (XGBoost), and random forest (RF), to accurately capture all consumers' overall ECP. The predictions from these base models are fed to a meta‐classifier multi‐layer perceptron (MLP). The MLP combines the learning capability of all the base models and gives an improved final prediction. The proposed structure is implemented and verified on the publicly available real‐time large dataset of the State Grid Corporation of China (SGCC). The proposed model outperformed the individual base classifiers and the existing research in terms of CPTA detection with false positive rate (FPR), false negative rate (FNR), F1‐score, and accuracy values of 0.72%, 2.05%, 97.6%, and 97.69%, respectively.

Clinical Usefulness of Machine Learning Approaches as a Non-Invasive Technology in Reducing Hepatitis Disease Mortality

Hepatitis is a viral infection that causes inflammation of the liver. However, other factors can cause the disease, including secondary effects from drugs, toxins, alcohol, and autoimmune hepatitis. The autoimmune form of the disease occurs when the body produces antibodies against the liver tissue, and many people worldwide are affected by it. Various clinical factors and parameters are examined in diagnosing hepatitis disease, which is analyzed by performing various tests of these factors and parameters. As a result of the vastness of the parameters under examination, it is challenging and complicated for the experts in this field to perform the analysis process on these parameters on a large scale. Healthcare experts can now identify the factors influencing the death rate of patients with high speed and accuracy thanks to emerging technologies such as machine learning, which is a subset of artificial intelligence. In this study, KNN and SVM machine learning techniques were used to analyze the positive effect of clinical parameters such as LIVER BIG, LIVER FIRM, SPLEEN PALPABLE, and ANOREXIA on patients' survival or death rates. This study investigates and analyzes the results of the implementation in two parts. The first part deals with determining the positive impact of these clinical parameters on the death and survival rate of patients, and the second part examines the performance of machine learning techniques based on the evaluation criteria of accuracy (ACC), error rate (ERR), specificity (SPE), and negative prediction value (NPV).Based on the implementation finding of machine learning techniques on data related to hepatitis patients, it has been determined that patients with positive LIVER BIG, LIVER FIRM, SPLEEN PALPABLE, and ANOREXIA clinical parameters can have a high chance of survival. On the other side, The SVM technique outperformed the KNN technique by ACC 94.05%, ERR 16.02%, SPE 93.07%, and NPV 85.7% in an analysis of the performance of machine learning techniques.

Streamflow forecasting for the Hunza river basin using ANN, RNN, and ANFIS models

Abstract Streamflow forecasting is essential for planning, designing, and managing watershed systems. This research study investigates the use of artificial neural networks (ANN), recurrent neural networks (RNN), and adaptive neuro-fuzzy inference systems (ANFIS) for monthly streamflow forecasting in the Hunza River Basin of Pakistan. Different models were developed using precipitation, temperature, and discharge data. Two statistical performance indicators, i.e., root mean square error (RMSE) and coefficient of determination (R2), were used to assess the performance of machine learning techniques. Based on these performance indicators, the ANN model predicts monthly streamflow more accurately than the RNN and ANFIS models. To assess the performance of the ANN model, three architectures were used, namely 2-1-1, 2-2-1, and 2-3-1. The ANN architecture with a 2-3-1 configuration had higher R2 values of 0.9522 and 0.96998 for the training and testing phases, respectively. For each RNN architecture, three transfer functions were used, namely Tan-sig, Log-sig, and Purelin. The architecture with a 2-1-1 configuration based on tan-sig transfer function performed well in terms of R2 values, which were 0.7838 and 0.8439 for the training and testing phases, respectively. For the ANFIS model, the R2 values were 0.7023 and 0.7538 for both the training and testing phases, respectively. Overall, the findings suggest that the ANN model with a 2-3-1 architecture is the most effective for predicting monthly streamflow in the Hunza River Basin. This research can be helpful for planning, designing, and managing watershed systems, particularly in regions where streamflow forecasting is crucial for effective water resource management.

Development of particle swarm clustered optimization method for applications in applied sciences

An original particle swarm clustered optimization (PSCO) method has been developed for the implementations in applied sciences. The developed PSCO does not trap in local solutions in contrary to corresponding solutions obtained by the applications of particle swarm optimization algorithm that is frequently used in many disciplines of applied sciences. The integrations of PSCO with multilayer perceptron neural network, adaptive neuro-fuzzy inference system (ANFIS), linear equation, and nonlinear equation were applied to predict the Vistula river discharge. The performance of PSCO was also compared with autonomous groups particle swarm optimization, dwarf mongoose optimization algorithm, and weighted mean of vectors. The results indicate that the PSCO has no tendency to trap in local solutions and its global solutions are more accurate than other algorithms. The accuracy of all developed models in predicting river discharge was acceptable (R2 > 0.9). However, the derived nonlinear models are more accurate. The outcome of thirty consecutive runs shows that the derived PSCO improves the performance of machine learning techniques. The results also show that ANFIS-PSCO with RMSE = 108.433 and R2 = 0.961 is the most accurate model.

Machine learning for product choice prediction

AbstractThe goal of this paper is to provide a point of empirical evidence as to how machine-learning techniques stack-up in their ability to predict consumer choices relative to traditional statistical techniques. We compare a traditional (naïve) multinomial logit to six machine-learning alternatives: learning multinomial logit, random forests, neural networks, gradient boosting, support vector machines and an ensemble learning algorithm. The comparison is done by applying these methods to beer category stock keeping unit (SKU) level panel data. Results show that machine-learning techniques tend to perform better, but not always. Ensemble learning performs best while maintaining an overall high-performance level across all SKU classes, independently of their sample size. This result builds on existing evidence about the benefits of combining multiple prediction techniques over relying on a single best performing model, as conventional wisdom would intuitively make us believe. In general, the better performance of machine learning techniques at predicting product choice should not come as a surprise. At their core, machine learning techniques are designed to augment dimensionality of models and/or scan through orders of magnitude greater model alternatives, relative to the narrower focus of traditional approaches.

Performance of Machine Learning Techniques for Meteorological Drought Forecasting in the Wadi Mina Basin, Algeria

Water resources, land and soil degradation, desertification, agricultural productivity, and food security are all adversely influenced by drought. The prediction of meteorological droughts using the standardized precipitation index (SPI) is crucial for water resource management. The modeling results for SPI at 3, 6, 9, and 12 months are based on five types of machine learning: support vector machine (SVM), additive regression, bagging, random subspace, and random forest. After training, testing, and cross-validation at five folds on sub-basin 1, the results concluded that SVM is the most effective model for predicting SPI for different months (3, 6, 9, and 12). Then, SVM, as the best model, was applied on sub-basin 2 for predicting SPI at different timescales and it achieved satisfactory outcomes. Its performance was validated on sub-basin 2 and satisfactory results were achieved. The suggested model performed better than the other models for estimating drought at sub-basins during the testing phase. The suggested model could be used to predict meteorological drought on several timescales, choose remedial measures for research basin, and assist in the management of sustainable water resources.

Application of wavelet theory to enhance the performance of machine learning techniques in estimating water quality parameters (case study: Gao-Ping River).

There are several methods for modeling water quality parameters, with data-based methods being the focus of research in recent decades. The current study aims to simulate water quality parameters using modern artificial intelligence techniques, to enhance the performance of machine learning techniques using wavelet theory, and to compare these techniques to other widely used machine learning techniques. EC, Cl, Mg, and TDS water quality parameters were modeled using artificial neural network (ANN) and adaptive neuro-fuzzy inference system (ANFIS). The study area in the present research is Gao-ping River in Taiwan. In the training state, using hybrid models with wavelet transform improved the accuracy of ANN models from 8.1 to 22.5% and from 25.7 to 55.3% in the testing state. In addition, wavelet transforms increased the ANFIS model's accuracy in the training state from 6.7 to 18.4% and in the testing state from 9.9 to 50%. Using wavelet transform improves the accuracy of machine learning model results. Also, the WANFIS (Wavelet-ANFIS) model was superior to the WANN (Wavelet-ANN) model, resulting in more precise modeling for all four water quality parameters.

Improving Classification Performance in Credit Card Fraud Detection by Using New Data Augmentation

In many industrialized and developing nations, credit cards are one of the most widely used methods of payment for online transactions. Credit card invention has streamlined, facilitated, and enhanced internet transactions. It has, however, also given criminals more opportunities to commit fraud, which has raised the rate of fraud. Credit card fraud has a concerning global impact; many businesses and ordinary users have lost millions of US dollars as a result. Since there is a large number of transactions, many businesses and organizations rely heavily on applying machine learning techniques to automatically classify or identify fraudulent transactions. As the performance of machine learning techniques greatly depends on the quality of the training data, the imbalance in the data is not a trivial issue. In general, only a small percentage of fraudulent transactions are presented in the data. This greatly affects the performance of machine learning classifiers. In order to deal with the rarity of fraudulent occurrences, this paper investigates a variety of data augmentation techniques to address the imbalanced data problem and introduces a new data augmentation model, K-CGAN, for credit card fraud detection. A number of the main classification techniques are then used to evaluate the performance of the augmentation techniques. These results show that B-SMOTE, K-CGAN, and SMOTE have the highest Precision and Recall compared with other augmentation methods. Among those, K-CGAN has the highest F1 Score and Accuracy.